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daa co™pr«sio« techniques may b. used such to 4. ta»sn,i«ed p^^™^ 
elemem to packer i^ud, fo, ^ ^ ^ ^ 

chafes be^««»cccaiv,fi»,s of. p„,g«„„„ekme«. Each proj^nune 
den>«« may ind^fc , p„d«.„^ ^ ^ ^ ^ 

prog«mne.len».tc„uldbem«ic„prfonlyastagkfi3me. For example, a dndc 
fcun. could be *„«ni«ed « p,« of a a«a pacta includiug voice da« describing 

that sirvgle fiaxne. 

Refeoing to Figu« 2. each tenninal convrises and input inters 
and. conventional display device 9. I>«.pamme el.m«tt data packets a,, stored in 

the bufier 8 and read out under the connol Of , comtonerlO which «ceives the 
Fopanme generation control d«. via input intetfic, 7 ami ntodem 2 iion, the 
telephone line 3. 

Each tenninal 1 receives a sseam of data »h!ch is delivered to the input 
mtetfice 7 fion, the modem 2, the Stan, of data incotponAig ptog^nune dement 

datapacteB.fom.achof«hi*on.or.seriesofvideoimages«,d associated audio 
ou*ut can be genaated. and comrol signals which are stfl»e,uen11y used to conttol 

thedisplayofprogtaumcetanentdatapacketsstotedintteboffer. ForexanpIe.fc 
buiftr nay be capable of stating d«, packets representiug ^ „Unu.es of a 
contmuous teaMme ptogtamme. If that data was to be read out to the display at a rate 
cone^onding to the uom»l 6ame .ate of a conventional television S)-stem, aU of the 
in.a£eda^.s,otedinthebuficrwouldbereado„tin«vominu<es. Assumingadaa 
tale on the telephone Une 3 «4ich is only one sixth of that required fo, continuous 
teal-time reproduction, only two minutes in evety twelve minutes of a real-time event 
could be reptoduced as data would be read out of fte buffer fester than it could be 
update! in the bufer. In .cconia»» wid, the p.«eat inv«.tion. programme element 
data is stored m the buffir for subsequent tquoduction in dependence upon conttol 
signals irom the controBer 10. the selection of programme element dam to be stored 
and reproduced being su* as to enhance the perceived quality of the programme 
appearing on the display 9. 

O 
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For example, if the progi^e element data packets received „,pn=sent a 
sporting event, image data representiAg only one sixth of the image data generated at 
thesportii^event^otadhelransmittedtothebuffer. Tl« received image data would 
however be replayed in a manner which effectively conceals the feet that image data 
representing periods of the spotting event .^ch are of fitde visual interest has been 
discarded. ^Hu. for «cample a ten second sequence leading up to the scoring of a goal 
would be transmitted once but might be leproduced several times. It will be 

^i^datedthatevenwilhconvenlionalreal-timelivetelevisionbioad^^ 
are often r.^ a number of times, thereby discarding some of the images 
gcneratedattheevent a relatively duU period of a match, programme element 
data related to a «toively more imcresling part of the event would be tmnsmitted to 
the tcmiinaL During a iclaiively dull period of an event, programme element data 
nught not be transmitted to the tmunal or. in the absence of any relatively more 
mterescing passages of ptoy, data packets could be transmitted which would be 
allocated a relatively low priority. A subsequently occurring passage of relatively 
greater interest could be subsequently transmitted and displayed as soon as it is 
resident in the bu&r. Accordingly by allocating different priorities to dilferent 
sequences of im^ a contioUer of the system can control the images displayed to the 
end user so as to maximise the perceived value of the programme that the images 
constitute. 

Figures 3 and 4 seek to fllustiatc one possible embodiment of the invention as 
described vn^ reference to Figures 1 and 2. Figu« 3 represents 15 successive 
programme events each of which is represented by a data packet identified by 
numbers 1 to 15. The system opentor allocates "value" to each of the programme 
elements in the form of a priority code, those codes being represented by letters A to 
J, ^th the letten, being allocated in orde, such .that the programme elements of 
maximum interest are allocated to a class identified by letter A and programme 
elements of minimum interest are aUocated to a class identified by letter J. For the 
purposes of this example, it wUl be assumed that each programme element lasts 
exactly one minute but requires two minutes to be transmitted to the temiinal. Th^ 
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» «p*U Of five o« 

Tie kft hand colimn in Pi.,™, a ^ 

'°™ '" * "P"^ a" "xralw of each of fte fifiea, 

l-e-- 4e second «, «1™b» i„ 4 »^ 
of five „k™^ U,o.m^^ 

«o»d « ft. end of «ch pcrtod, and U» 1«« i. ac sev«a. to d««h ^te™, 

''/^ to to the ta period p™E,ann»dem».lbge«^ 
~«Itofte«„nM^4,„^ laewi,»i.*eseo.„d.ftirf,fc^^ja, 
P«,ds.ft.se«^„fi«,p,^^„^^^^^^^^ 

A.th«meind»p,oc.sste,M,«^«i^^^ Du™gtow,aM»te 

penod ttc user will have been p^emed ,.ri« of h^ges made «p ftoo, fte 
-fi-ationasao^d. For example d^g fl„ fifih p«i„4 , 

and 2 be pn«oW «,»»,dally dodng Ok aoK ftat fte fiftt eleam is being 
dehve«L Tl» prognran,. .Ien«t tas a higher pnoriO- ftan fte 
P«>i»nmie element and fterefore i, i, ,„«»itted and i„ ,he to memo., 

loc-m ^»«««h«'"»<teal<™„piorityflBnany,ffl„9„redp,ogramne 
elemems and fl^o„ „„, ^ ^ ^ 

than fte oldest of H vatae pmgamntt element (prog^me element 4) and 
taeftreislB.smi.,edand,q,l.ces.h.,da„entu„heao«. Tie ninth element a,en 

replaces the fiM pregranme d«nent, the tent element Kplaces the sixth el™^^ 
the ele«ah element ttplaces the ihiri element, the tweliih elematt i, »M ttan^ 
as « has a lo«er «I„e than my of the stoied values, «,e thirteenth element is no, 
•"^n^M as it has a lo«« «d„e than any of the stored vahtes, the ft^rt^ 
etaent ^ ttasmitied as it has a higher value than progiamne element 2, but the 

fifteenth element fa not trasmitted as it has a low valne than any of the stoted 

values. 

Clearly if simple m«ine eccoidmg to Figure 4 ™i folWd without feil 
m the end all of the memo,, locati^s would be fiUed with high «due progmmme" 
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elements which might, depending on the application, become "stale", in which case 
one could have a routine for example to leduce the priority of stozed pwg^e 
elements over time so that the stored pmgrammc elements are "refieahed". For 
example the prioriQr level of any s1»ied programme element could be reduced by one 
st^ eveiy two cycles of the routine. 

Figures 3 and 4 explain how programme data packets are delivered to a 
tenninal but do not explain (he manner in vduch those packets arc used to generate a 
programme. Mat^r alternative coniiol schemes could be envisaged. For example, the 
terminal could automatically generate a programme fiom tite stored elements, cycling 
through the stored elements in a predetermined manner. For example aU A priority 
programme elements could be repeated say three times, all B priority programme 
elements could be repeated once, and so on. Programme elements could be of varied 
duration so as to enable the aUocated priorities to represent programme elements 
which begin and end with natural break intervals, for example to coincide with 
interruptions in play. As an alternative to automatic programme generation control 
howcN-er, it would be possible for the operator of the terminal to have total control of 
the images presented, for example by presenting the operator with an image 
representing the priority value allocated to the locally stored programme elements for 
direct selection of programme elements of interest by the temiinal operator. 

Figure 5 is a graphical rcpxcseatation of a process which can be used to 
generate a data stream the content of which enables the operator of a temmal 
receiving that data stream to "edU" a set of received programme elements to produce a 
programme uniquely ad^ted to the user's wishes. Figure 6 represents the handlir»g of 
flie data stream at the user tcrmmal. Figure 7 the appearance of a screen represented to 
a smaller scale in Figure 6, and Figure 8 a series of symbols or 'icons' displayed on tire 
screen of Figure 7 with a series of sequence nurnbers to assist in understanding the 
description of its significance of tiiose icons set out below. 

Referring to Figure S, data represented by arrow 11 is captured by a TV 
camera 12 to produce a stream of digital data represented by arrow 13, that digital 
data defining the video and audio content of the events taking place in ftont of tiie 
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event The combined data 14 and KicniTh..^-. 
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» fte p„p»„e d«n«ts. . ,^ ^ ^ ^ ^ 

R=ftni.«to Figro 7, IMS isal^Eernrn^dacBon of th. «,een 20 of Fip^ 
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K«ftniag to Figure li. icoos a the fcot of tl» sc^n *„™ ta 

dalapad^ts « tatagdcU«,od«ar.te»d>tota«d^ ^„«ion of a liv, 
event 03, be p^facc^fl^dfapUyscrea^m show the live ^„„. p,.,^^ 

elements of partculer in.««t aK however s..^ ft, to reptoduction, each aoKd 
l»OE.a™e element beitig Classified »d,q,:«eonrf by an associated ia^ Tiete 

.conoonespondsto"ldA.ff,,h«is4etopassag.of,h.g.„„. Tl««condico„ 
uuheates a high quality passing s«r„^ . ^ ^ 

.Shot on goal, the fi«hayellow«iwa,ni^top^^j_^^,^^ 
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high quality passing sequence, ihe seventh a goal the dghth a 
ninth a further yellow card waning to player number 4, the tenth a penalty.' the 
eleventh another goal, the twelfth half time (45 minutes), the thirteenth anotherhigh 
quality passing sequence, the fourteenth a comet, the fifteenth a penalty, and the 

sixteenth another goal. Home team icons m«o' be higfaligttedfbr example in red and 
away team icons in bla^ 

Tte icons appear from the bottom left of the screen and continue moving to 
the rigjii as the game progresses. Tliis means that the oldest recorded events are oti 
the light Further events wiU cause ae oldest events to be displaced. 

The programme dement data packets xepresented in Figure 8 are generated by 
storing only data packets including events which arc of interest to the terminal 
operator as defined by a minimum priority set by that operator, for eotan^Ie none of 
the recorded programme elements corresponds to boring periods of play. The user 
. can simply review the icons and switch between different icons using a keyboard or 
remote control device in a conventional manner, for example by moving a cursor on 
thesimnlatedcontrolpanelatthebottomrightbandcomcrofFiguie?, Itiseasyfbr 
the operator to see in the example represented in Figure 8 that there were t&n 
highlights exceeding the operators threshold setting before half time. The colour of 
the icons wiU mdicate wWoh team if any dominated play. It can be seen that there 
was a good passing movement, a good long forward pass before an identified player 
received a yeUow card. The first half included two goals for teams identified by the 
colour of the associated icon. The current score can be deteimmed by lookijjg at the 
colourofflieflireeiconsiepresentingthfiscQringofagoaL Tlie temrinal operator has 
the choice of either seeing the whole broadcast programme, seeing aU the highlights, 
or jumping through the sequence of highlights in any desired oirier. 

Thus a tenninal operator can either watch a programme in a conventional 
manner, or skip through parts of a broadcast programme looking at only those secUons 
of real interest, or periodicaUy review the displayed icons to see if anythmg of 
sufficient inHsrest has happened to merit fijtther attention. The operator can thus use 
the system to identify programme elements of interest without it being necessary for 



3 



6.Jm.2000 13:16 MARKS & CLERK n/C 0161 235 5846 ISO. 883 P. 17/46 

PCT/GB98/01817 . 

13 

the operator to do moie than glance occasionaUy at the screen. The operator can make 
adedsioatorecordaUoronlyhighhghtsofabioadcastprogi^ 
programme by actively selecting progr^e elements to be displayed, or allow the 
system to make a selection of programme elements to be stored in accordance with a 
predetermined value selection keyed into the terminal at an earlier time by the user, or 
aUow the generation of a continuous programme by aUowirjg the classification data 
tram^tted with the programme elements to control programme generation in 
accordance with a defeuli set of value selections determined by the system provider, 
n» system can be used in circumstances where the data delivery communications 
chamifil can carry data at a rate suflScient to accommodate all of the leal-thne 
programme transmission, or at a rate higher than a conventional transmission (to 
aUow the generation of for example high definition images), or at a rate lower than 
normal transmission (in which case a "ftll" programme can be achieved by repeating 
previously stored programme elements as necessary). 

In terms of Ae significance to the user of the capabilities of the system, the 
terminal gives great flexibility so that the terminal operator can dhoose to experience a 
broadcast event in any of a large number of ways, for example by: 

1 . Setting a threshold value to select only highlights of a transmission. 

2. Setting athreshold value ^^ch could be transmitted to the programme source 
and used at that programme source to select "above threshold" passages of play ftom 
for example more than one sporting event. 

3. Displaying by means of icons a "storyboard" of a sequence of events to allow 
rapid access to events of particular significance. 

4. Choosing to permanently record any set or subset of highlights. 

5. Recalling and replaying any stored item at will substantially instantaneously. 

6. Storing programme elements and associated icons for review at the icon level 
or asa full programme ata later time. 

7. Storing automatically only the Wghlights of an event for later review, thereby 
reducing storage requirements. 
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8. Ammging for the system to take out elements of a broadcast event of Utde 
interest to tibe viewer. 

9. Watching a piogramme Uve and automatically storing hiehlights for later 
replay. 

10. Using the system to "wtch" a programme so as to alert the operator when 
somedang intetestiiig is heqjpeniiig. 

In reduced bandwidth systems in which fte available bandwidth does nor 
allow the deUvery to the uset-s tenninal of all of the real-time broadcast signal, it is 
necessary to -expand" the time oceui^ed on the screen by transmitted programme 
elements so as to "fill in" periods of time during which piogiamme elements are being 
transmitted. This can be achieved by simply repeating programme elemenis. 
assnming that each viewed programme element conesponds to the simple 
reproduction of a real-time series of events, or by using still images and associated 
audio signals. There are many occasions, particularly daring lapses in action, where a 
still picture and weU reconled sound is better than poor video in terms of enhancing 
the entertainment value. Such an appUcation of the present invention is described 
with referojce to Figure 9. 

Figure 9 represents a screen which has been split into four sections A to D. 
These different sections can be used for any specific purpose, can vary in size, and 
their usage may be changed according to the dynamics of (he broadcast material. For 
the purposes of Ulusttation section A of Figure 9 may be used to display a moving 
video picture, section B diagrams or graphs, and section C a high quality still picture. 
An associated audio programme is also produced. For example, the system iUustrated 
schematicaUy in Figure 9 can be used in association with the broadcast of a 
programme describing a golf toumament. A golfer msy be shown standing on the 
feirway of a particular hole at a famous gold conrse" in section A of the screen. The 
golfer can be describing the beauty of the course and how he would play that hole. 
Section C of the screen can be used to present a very high quality image of the golfer's 
current location. Section B may contain a plan of the hole showing where the golfer's 
first drive finished, with distance madcos, ranges and the Kke. 
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The golfer can M«rk to a sciq,t which directs the usert attention to selected 
parts of the screen. For ttaniple the golfer may diaw the attention oftheterniinal user 
to the the ground fells fflwy to the left, the dangers of over-pitching straight into 
a bunker guarding the green, and the beauty of the course and various geographical 

features. All the time fi«t the golfer is delivering this message, there is no motion at 
aU on the screeiL If the golfer talks for 20 seconds about the still picture image on the 
screen, this gives 20 seconds for the next video section to build up in the system 
buffer. That next video section can then be replayed at a higher speed than that at 
whichitws recorded in the bufifer so as to improve the perceived quaUty. 

Further pre-recorded data packets may be used to make up the final 
programme. For example an illustration of the golfer's technique of relevance to the 
particular hole m^ be taken from a Ubraiy of information held on a CD in the PC CD 
drive, that information being displ^ed in section A of the screen whilst a sponsors 
message appears in place of the course plan in section B. 

Section D of the screeu shows icons, in the iUustrated ease numbers, which are 
either subjective latiogs by the programme producer of die significance of associated 
programme elements, or identify particular events in a manner similar to the football 
example iUustiatEd hi Figures 5 to 8. ITiis makes it possible to the user to jump 
between sections of the programme, repeating sections of interest at will, thereby ouce 
again obtain control over die programme as a whole. 

It will be appreciated that programme elements can be reproduced setiaUy, that 
is a programme could be made iqi of programme elements presented one at a time 
with no overlq) between successive elements, or in parallel, that is a programme may 
be made up of programme elements some of which will be presented simultaneously. 
The simultaneous presentation of programme elements could enhance a user's 
appreciation in various ciicumsbnces. For example, if a programme to be presented 
to a user is intended to represent the progress of a car race, most of a display screen 
could be occupied by an image showing the two leading cars in die lacc, widi the 
remaining area of the screen showing an image representing the approach to the finish 
line of thai race. Such combinations of images can enhance the qjpreciation of a 
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progranune by linking together two events where a first one of the events (the relative 
position of tiic two leading cars) and a second event (their approach to the finishing 
line) is of significance to an overall appreciatioa of the subject of the piogranmie. 

It will also be appreciated thai combinationa of images can be presented either 
serially or in parallel so as lo enhance the impact of advertisements by linking the 
presentation of particular advertisements to the occurrence of particular events. For 
example, programme elements representing the progress of a motor race may be 
combined with a programme element representing advertising images the presentation 
of -which can be linked to the progress of the race. One possibility would be to put on 
the screen advertisiDg materiQl rdevant to the sponsor of a race car or the supplier of 
tyres to a race car at the lime that race car succcssfiillyOTsses the A 
sponsor's message could thus be superimposed on or othocwise ciambinfid vdA images 
of the vmming race car and driver. 

The embodiments of the invention described above assume that programme 
element classification is controlled by the source of the programme elements. It is 
possible however fbr a user of the system to detOTtime the programme element 
classifications, either to replace classifications set by the programme element source, 
or to establish a set of programme elements and associated classifications ftom an 
unclassified broadcast programme, For example, a user could receive a broadcast of 
an event, store the entire broadcast, divide (he stored programme into programme 
elements of interest, and set classifications for each programme element of interest 
Thus a user tould classify programme elements related to a sporting event on a basis 
ideally suited to the interests of that user, th«:eby enabling a subsequent reproduction 
of ttie programme elements in a manner controlled by reference to the user's own 
classification system. A user would not then be forced to rely upon the classification 
system considered appropriate by the programme. element source but could set up 
classifications matching the particular user's interests however idiosyiKaatic those 
interests might be. 

Programme element classification can be used in a variety of ways, for 
example to ^une stamp'* the beginning of one programme element in a programome 
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made up fiom a series of sequentially presented progranmie elements. Thus a user 
wishing to suspend a piogianmie for a period of time so as to eaiable for example a 
telephone call to be answered could in effect apply a "time stamp" classification to the 
programme element being watched at the time the decision to suspend is made, the 
applied classification being a flag idealising the point in the programme to >*Wch the 
viewer will wish to return after viewing restarts. The time stamp classification would 
in effect modify tiie manner in \^ch stored programme elements are presented by 
causing the system to bypass all earlier programme elements in the series of 
programme elements making up the prograirime to be viewed. 

In embodiments of the invention described with reference to Figures 3 and 4, 
programme elements are clasafied by reference to a "value" assessment of individual 
elements. In the embodiment of the invention described with reference to Figures 7 
and classification is by reference to the nature of the event It will be appreciated 
thai various graphical representations of the classifications associated with individual 
progranmae elements could be presented to users. For example, in a classification 
system based on programme dement Values'* on a scale of 1 to 10, the values of a 
series of programme elements representing successive events in a real-time broadcast 
programme may be presented in the form of a bar chart, each bar of the chart having a 
length corresponding to the value in the range 1 to 10 allocated to a respective 
progranune element. Such a presentation of the classifications of individual 
programme elements would enable a user to rapidly access any series of programme 
elements which on the basis of Ae allocated value classifications is likely to be of 
significant interest 




